Image processing method, image processing apparatus and recording medium

ABSTRACT

An image processing method of quantizing multi-tone image data by an error diffusion method, includes the steps of a) detecting change of the image data; and b) oscillating cyclically in image space a threshold for the quantization in an oscillation range controlled according to the detection result of the step a).

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention generally relates to an image processing method,an image processing apparatus and a recording medium, and in particular,to an image processing method, an image processing apparatus and arecording medium employing an error diffusion method for quantizingmulti-tone image data.

2. Description of the Related Art

In many cases, a dither method or an error diffusion method is employedin quantization of multi-tone image data for falsely reproducing tonesof a multi-tone image in a laser printer, a digital copier, a displaydevice, and other various image processing apparatus, for example.

Generally, the dithering method has advantages such that graininess issuperior and it is possible to represent a halftone image smoothly.However, by such an area halftoning method, typically, the ditheringmethod, resolution is degraded for achieving halftoning. Further, by theditherintg method by which a cyclic image is generated, a moiré patternis likely to be generated when a printed image such as that consistingof halftone spots is processed.

On the other hand, when the error diffusion method is used, it ispossible to obtain resolution close to an original image, and the methodis suitable for reproducing a character/letter image.

However, in the error diffusion method, when a halftone image such as aphotograph is processed, isolated dots are dispersed, or dots arearranged continuously irregularly, and, thereby, graininess is notsatisfactory. Further, peculiar textures may be generated, as is wellknown.

Further, in an electrophotographic printer, a printed image is likely tobe not stable because the image is formed of isolated dots. Inparticular, when the error diffusion method is used in such a printer, arate of occurrences of small isolated dots increases, thereby, theinstability further increases, and degradation of graininess due toshade unevenness and banding (band-like shade unevenness) are likely tooccur. With regard to the error diffusion method, in order to eliminategeneration of textures due to irregular continuation of dots, thefollowing modification arts, such as that in which a dither threshold isused as a quantization threshold so as to disturb continuation of dots,for example, have been proposed:

(1) An amount of error diffusion is increased as an edge amountincreases for the purpose of eliminating generation of pseudo-contoursand special stripe patterns (Japanese Laid-Open Patent Application No.3-34772);

(2) For the purpose of preventing generation of a white blank at anon-edge, light-shade portion and preventing generation of notches incharacters, a fixed threshold is used for an edge portion of an image,while a variable threshold is used for a non-edge portion, and the levelof the variable threshold is lower as the shade is lighter (JapanesePatent No. 2755307); and

(3) For the purpose of preventing generation of moiré patterns andpseudo-contours when a multi-level printer of more than two levels isused, a dither signal having a magnitude according to an edge amount isadded to image data for an edge portion of an image, while a fixed valueis added to image data for a non-edge portion, and, the image data thusobtained is quantized into multilevel digital data using a fixedthreshold (Japanese Patent No. 2801195).

SUMMARY OF THE INVENTION

An object of the present invention is to provide an improved imageprocessing method and an improved image processing apparatus, forproducing high quality images, in which, as a result of compensatingdefects of the error diffusion method, changing points of characters andother images are represented with high resolution, while portions ofphotographs and images where change is a little are represented smoothlyand stably, and the portions of both types match one another withoutincompatibility.

Another object of the present invention is to provide an imageprocessing method and an image processing apparatus by whichhalftone-spot images can be reproduced with high image quality.

Further, in a configuration as in the proposal of Japanese Patent No.2801195 in which a dither signal is added to image data as describedabove, image data overflows as a result of the dither signal being addedwhen the image data has a saturated level or an approximately saturatedlevel. If image data is reduced in order to avoid such a situation, theshade is saturated. In order to solve the problems, it is necessary towiden the operation range of image data in expectation of addition ofthe dither signal.

In view of this matter, another object of the present invention is toprovide an image processing method and an image processing apparatus bywhich, it is not necessary to widen the operation range of image data,but high quality images can be produced.

Other objects of the present invention will now be listed:

High grade images having cyclicity which is not remarkable to the senseof sight of human being, having little deformation of halftone spots andhaving satisfactory graininess can be produced;

High grade, smooth images having superior stability in light shadeportions can be produced;

High grade, smooth images having cyclicity agreeable to human being canbe produced;

High grade images having little deformation of halftone spots and havingsatisfactory graininess can be produced;

High grade, smooth images having superior stability in particular inimage flat portions can be produced;

High grade images having high resolution in relatively coarsehalftone-spot image portions, character portions or the like and smoothand stable in relatively fine halftone-spots image portions, photographportions or the like can be produced; and

A high grade, balanced image can be produced from image data havingvarious characteristics.

According to the present invention, in an image processing apparatus andmethod of quantizing multi-tone image data by an error diffusion method,on order to generate output dots of an image concentratedly andcyclically for a portion in which change of the image data is small soas to improve stability and graininess of the image, change of the imagedata is detected, and a threshold for quantization is cyclicallyoscillated in the image space in an oscillation range controlledaccording to the detection result of the detection of change of theimage data.

Further, according to the present invention, in order to achieve bothresolution of an edge portion of an image and stability and graininessof a flat portion of the image, an edge degree of the image data isdetected, and the oscillation range of the quantization threshold iscontrolled in multi-levels according to the edge degree.

Further, according to the present invention, in order to improvereproducibility of a halftone-spot image portion and to prevent moirepatterns from being generated, cyclicity of change of the image data isdetected, and, according to the detection result, the oscillation rangeof the quantization threshold is controlled.

Further, according to the present invention, in order to achieve bothresolution of an edge portion of an image and stability and graininessof a flat portion of the image, and, also, to prevent moiré patternsfrom being generated, an edge degree of the image data is detected,region expansion processing is performed on the edge degree, and theoscillation range of the quantization threshold is controlled inmulti-levels according to the edge degree having undergone the regionexpansion processing. Further, in order to achieve high resolution andprevent moiré patterns from being generated for a halftone-spot imagehaving an image space frequency (halftone-spot occurrence cycles perinch) employed in general printing, the expansion extent of the regionexpansion processing is selected to be within 0.5 mm in the image space.

Further, according to the present invention, in order to form a stable,high-quality image in an electrophotographic printer or the like inwhich discrete separate dots are used for forming images, by causing aflat portion of an image to oscillate cyclically in a wide oscillationrange, the quantization threshold is oscillated approximately around thecentral value of the data range of the image data, and the maximumoscillation range is set to be equal to or larger than ⅓ the data range,and the image data is quantized into two levels.

Further, according to the present invention, in order to simplify theconfiguration relating to generation of the quantization thresholds, aplurality of fluctuating values oscillating in respective differentoscillation ranges cyclically in the image space are generated, and, onethereof is selected according to the edge degree, and, thus, thequantization threshold being generated.

According to the present invention described above, the followingadvantages can be obtained.

(1) By detecting change of multi-tone image data and oscillating thequantization threshold of the error diffusion processing in theoscillation range according to the detection result, it is possible toobtain high resolution by performing processing mainly based on errordiffusion for characters or image changing points, and to obtainimproved graininess and stability of image and to reduce shadeunevenness and banding by performing processing mainly based ondithering for photographs or portions in which change of image is alittle.

(2) By controlling the oscillation range of the quantization thresholdaccording to the edge degree, it is possible to achieve both resolutionof image edge portions and stability and graininess of image flatportions, and, also, to express transition regions between both theimage portions smoothly and to make the both to match one anotherwithout incongruousness.

(3) By detecting the cyclicity of change of the image data andcontrolling the oscillation range of the quantization thresholdaccording to the detection result, a fine halftone-spot image isevaluated as an edge portion, and, therefor, processing mainly accordingto the error diffusion technique using a fixed quantization threshold ora oscillating quantization threshold in a small oscillation range isperformed. Thereby, it is possible to reproduce halftone spotsfaithfully with high resolution, and to prevent moiré patterns frombeing generated.

For halftone-spot images of a low halftone-spot occurrence cycles perinch (image space frequency) for which it is difficult to performsmoothing processing with resolution left un-degraded, halftone-spotperipheral portions evaluated as edges are processed mainly according tothe error diffusion technique using fixed quantization thresholds oroscillating quantization thresholds in small oscillation ranges.Accordingly, the halftone spots are reproduced faithfully, and also,moiré patterns are prevented from being generated. Further,halftone-spot central portions not evaluated as edges are processedmainly according to the dithering technique using oscillatingquantization thresholds in large oscillation ranges. Accordingly, it ispossible to express these portions with satisfactory stability andgraininess.

(4) By detecting the edge degree of the image data, and, controlling theoscillation range of the quantization threshold according to the edgedegree having undergone the reign expansion processing, a relativelyfine halftone-spot image, a character or a line drawing, is evaluated asan edge portion, and, therefor, processing mainly according to the errordiffusion technique using a fixed quantization threshold or aoscillating quantization threshold in a small oscillation range isperformed. Thereby, it is possible to reproduce halftone spotsfaithfully with high resolution, and to prevent moiré patterns frombeing generated.

Halftone-dot components of high halftone-spot occurrence cycles per inchequal to or higher than 175 Lpi are not left in the smoothed image data.Accordingly, for halftone-spot images of such high halftone-spotoccurrence cycles per inch such as photograph in which image change is alittle, they are processed mainly according to the dithering techniqueusing oscillating quantization threshold in a large oscillation rangesame as for image flat portions. Thereby, they are converted intohalftone spots at the dither threshold cycles. Accordingly, it ispossible to form images superior in graininess and stability, and, also,to reduce banding and shade unevenness. Further, because halftone-spotcomponents are removed from the image data, no moiré patterns aregenerated.

Further, by controlling the oscillation range of quantization thresholdin multi-levels, it is possible to express transition regions betweenboth the image portions (character, line drawing or a coarsehalftone-spot image region and a photograph, a flat portion or a finehalftone-spot image region) smoothly and to make the both to match oneanother without incongruousness.

(5) By selecting the expansion extent of the region expansion processingto be within 0.5 mm, a relatively fine halftone-spot image frequentlyused in general printing is processed mainly based on error diffusion,thereby, the halftone spots are reproduced with high resolution, and,thereby, moiré patterns can be prevented from being generated.

(6) By selecting the maximum oscillation range of the quantizationthreshold to be equal to or larger than ⅓ the image data range, it ispossible to reproduce an image flat portion with stable, high imagequality when an electrophotographic printer or the like is used.

(7) By oscillating the quantization threshold, it is possible to avoidoverflow of image data, saturation of shade, and eliminate necessity ofexpansion of the operation range of image data needed in a configurationin which a dither signal is added to image data.

(8) By generating a plurality of fluctuating values oscillatingcyclically in respective different oscillation ranges in the imagespace, selecting one thereof according to the edge degree, and thusgenerating the quantization threshold, it is possible to omit processingof adding a fixed value, and multiplication processing disadvantageousin view of costs and processing time in general. Accordingly, it isfurther easier to achieve the configuration by hardware.

(9) It is possible to achieve image processing apparatuses such as aprinter, a display, a scanner, a facsimile machine, a digital copier andso forth, by which it is possible to reproduce with high image qualityimages containing characters, line drawings, photographs, halftone spotsand so forth mixed therein.

According to another aspect of the present invention, an imageprocessing apparatus includes a quantization threshold generating partgenerating the quantization threshold oscillating cyclically, and anerror diffusion processing part using the thus-generated quantizationthreshold, quantizing input multi-tone image data by an error diffusionmethod and outputting quantized data.

Further, in order to form images having cyclicity not likely to beremarkable to human eyes, having a little deformation of halftone spots,and also, superior in graininess, the quantization threshold generatingpart uses a dither threshold matrix for forming halftone spots having aspace image frequency in the range of 100 through 250 Lpi for generatingthe quantization thresholds.

Thereby, images having cyclicity not likely to be remarkable to humaneyes are formed through concentration of dots performed in the range ofresolution of an electrophotographic printer or the like. Accordingly,it is possible to form high-grade images superior in graininess andhaving a little deformation of halftone spots.

In order to form high-grade images having directionality not likely tobe remarkable to human eyes, the quantization threshold generating partuses a dot-concentration dither threshold matrix having a screen angleof around 45° for generating the quantization thresholds.

Thereby, high-grade images having directionality not likely to beremarkable to human eyes can be formed, and, also, change of imageimpression is not remarkable even 90° rotation processing is performed.

In order to form smooth, high-grade images superior in stability forlow-shade portions, the quantization threshold generating part uses adither threshold matrix obtained from combining a plurality of basicdither threshold matrixes, wherein adjacent basic dither thresholdmatrixes are relatively shifted by a half phase in a directionperpendicular to the adjacent direction.

Thereby, halftone-spot development starting points are arrangedstaggeringly, and, for low-shade portions, stable, smooth, high-gradeimages can be formed.

In order to form smooth, high-grade images having cyclicity conformableto human eye sight, the quantization threshold generating part uses adither threshold matrix obtained from combining a plurality of basicdither threshold matrixes each having a size of four pixels in each ofmain and sub-scanning directions, wherein adjacent basic ditherthreshold matrixes are relatively shifted by a half phase in a directionperpendicular to the adjacent direction.

Thereby, halftone spots of 150 Lpi are formed in image formation of 600dpi, and it is possible to form images having cyclicity comfortable forhuman eye sight.

In order to form high-grade images having superior graininess and alittle deformation of halftone spots, the quantization thresholdgenerating part uses a dither threshold matrix obtained from combining aplurality of basic dither threshold matrixes, wherein adjacent basicdither threshold matrixes are relatively shifted by a half phase in adirection perpendicular to the adjacent direction, and having a cycle ofhalftone-spot development starting points of eight pixels in a mainscanning direction and four pixels in a sub-scanning direction.

Thereby, intervals of on/off of halftone spots in the main scanningdirection are long, and, therefore, it is possible to form images havinga little deformation of halftone spots and having superior graininess.

In order to form smooth, high-grade images superior in stability forimage flat portions, the quantization threshold generating part uses adither threshold matrix for forming lines extending in a sub-scanningdirection for forming the quantization thresholds.

Thereby, it is possible to form smooth and high-grade images superior instability especially for image flat portions, by lines extending in thesub-scanning direction made of dots arranged continuously in thesub-scanning direction.

In order to form images with high resolution for characters or imagechanging points, and smooth and stable for photographs or portionshaving a little image change, and in which both the regions match oneanother without incongruousness, an edge detecting part detecting anedge level of input image data is further provided, and the quantizationthreshold generating part controls the oscillation range of thequantization threshold according to the thus-detected edge level.

Thereby, it is possible to form images with high resolution forcharacters or image changing points and smooth and stable forphotographs or portions having a little image change, and in which boththe regions match one another without incongruousness.

In order to form images with high resolution for characters orrelatively coarse halftone-spot image portions and smooth and stable forphotographs or fine halftone-spot image portions, and in which both theregions match one another without incongruousness, an edge detectingpart detecting an edge level of input image data and a region expansionprocessing part performing region expansion processing on the edge dataare further provided, and the quantization threshold generating partcontrols the oscillation range of the quantization threshold accordingto the edge level having undergone the region expansion processing.

Thereby, halftone-spot images can be reproduced with high resolution.

Further, in order to form well-balanced, high-grade images for imagedata having various characteristics, the quantization thresholdgenerating part controls the oscillation range of the quantizationthreshold according to the edge level (detected by the edge detectingpart or further having undergone the region expansion processing), and,also, switch the dither threshold matrix used for generating thequantization thresholds according to an externally specified mode.

Thereby, it is possible to form high-grade, well-balanced images suitedfor characteristics of original images.

According to another aspect of the present invention, multi-tone imagedata is quantized by quantization processing by an error diffusionmethod, dots are output according to the quantized data, and images areformed, wherein the quantization threshold for the quantizationprocessing is caused to oscillate cyclically.

Specifically, in order to make dots be easy to be concentrated, and,also, avoid continuation of dots of adjacent cycles in low ormedium-shade portions, and to achieve stable image formation, theoscillation of the quantization threshold is controlled so that outputdots develop spirally outward in a specific cycle of the image space asthe shade level of the multi-tone image data increases.

In order to make dots be easy to be concentrated in a neat shape bydeveloping output dots in a direction determined in consideration of adirection of propagation of quantization errors, the oscillation of thequantization threshold is controlled so that the output dots developclockwise when the error diffusion processing is performed from the topleft to the bottom right in the image space, and counterclockwise whenthe error diffusion processing is performed from the top right to thebottom left in the image space.

In order to avoid blank occurrences in high-shade portions, theoscillation of the quantization threshold is controlled so that outputdots develop dispersedly for high-shade portions of multi-tone imagedata.

In order to achieve formation of smooth, high-grade images not likely tobe adversely affected by shade change by controlling shift of thecentral positions of halftone spots through from low-shade portion tohigh-shade portion, the oscillation of the quantization threshold iscontrolled so that the output dots develop concentratedly in the centralportion of a specific cycle of the image space for low-shade portions ofmulti-tone image data, and output dots radially develop dispersedly inthe peripheral portion of the specific cycle of the image space formedium or high-shade portions of multi-tone image data.

In order to achieve dot development in the sub-scanning direction withpriority (vertical-based dot development) not likely to be adverselyaffected by noise such as banding in electrophotographic printer or thelike for low-shade portions, the oscillation of the quantizationthreshold is controlled so that output dots develop in the sub-scanningdirection with priority for a low shade level region of the multi-toneimage data.

An image processing apparatus according to another aspect of the presentinvention comprises a quantization threshold generating part generatinga cyclically oscillating quantization threshold; and an error diffusionprocessing part quantizing input multi-tone image data using thequantization threshold generated by the quantization thresholdgenerating part by an error diffusion method, and outputting quantizeddata.

In order to make dots be easy to be concentrated, and, also, avoidcontinuation of dots of adjacent cycles in low or medium-shade portions,and to achieve stable image formation, the quantization thresholdgenerating part generates the quantization threshold using a ditherthreshold matrix in which thresholds are arranged spirally outward inthe ascending order.

Thereby, it is possible to form stable images.

In order to make dots be easy to be concentrated in a neat shape bydeveloping output dots in a direction determined in consideration of adirection of propagation of quantization errors, the dither thresholdmatrix is such that the threshold sequentially increases clockwise orcounterclockwise selected according to the direction of the errordiffusion processing.

Thereby, it is possible to form images superior in stability andgraininess for low and medium-shade portions.

In order to avoid blank occurrences in high-shade portions, the ditherthreshold matrix is such that the thresholds are arranged dispersedly inthe ascending order in the peripheral portion thereof.

Thereby, blank occurrences in high-shade portions can be reduced, and,also, dot concentration is made to be easy to be performed for low andmedium-shade portion. Accordingly, it is possible to form images inwhich blank occurrences are not remarkable and also superior instability, smooth and of high grade.

In order to achieve formation of smooth, high-grade images not likely tobe adversely affected by shade change by controlling shift of thecentral positions of halftone spots through from low-shade portion tohigh-shade portion, the quantization threshold generating part generatesthe quantization threshold using a dither threshold matrix in whichsmall thresholds are arranged concentratedly in the central portion andthresholds larger than them are dispersedly arranged radially in theascending order.

In order to achieve dot development in the sub-scanning direction withpriority (vertical based) not likely to be adversely affected by noisesuch as banding in electrophotographic printer or the like for low-shadeportions, the thresholds are arranged in the ascending order so as to bearranged in the sub-scanning direction with priority in the centralportion of the dither threshold matrix.

Thereby, it is possible to form high-grade images superior in stabilityfor low-shade portions.

In order to achieve formation of images superior in stability for imageportions such as photograph in which image data change is a little, andwith high resolution for image portions such as character in which imagedata change is large, and in which both regions match one anotherwithout incongruousness, an edge detecting part detecting an edge levelof the multi-tone image data is further provided, and, the quantizationthreshold generating part controls an oscillation range of thequantization threshold according to the edge level detected by the edgedetecting part.

Thereby, it is possible to form high-grade images.

In order to achieve formation of high-grade images superior in stabilityfor image portions such as not only photograph but also finehalftone-spot images, and with high resolution for image portions suchas not only character but also relatively coarse halftone-spot images,and in which both regions match one another without incongruousness, anedge detecting part detecting an edge level of the multi-tone image dataand a region expansion processing part are further provided, and, thequantization threshold generating part controls an oscillation range ofthe quantization threshold according to the edge level having undergonethe region expansion processing performed by the region expansionprocessing part.

Thereby, it is possible to form high-grade images.

Other objects and further features of the present invention will becomemore apparent from the following detailed description when read inconjunction with the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a block diagram of one example an image processingapparatus according to the present invention;

FIGS. 2A, 2B, 2C and 2D show differential filters for edge detectionaccording to the present invention;

FIG. 3 shows a block diagram of one example of a quantization thresholdgenerating part according to the present invention;

FIG. 4 shows one example of a dither threshold table for quantizationthreshold generation according to the present invention;

FIG. 5 shows a block diagram of another example of a quantizationthreshold generating part according to the present invention;

FIGS. 6, 7, 8 and 9 show examples of dither threshold generating ditherthreshold tables for quantization threshold generation for edge levels0, 1, 2 and 3, respectively, used in the quantization thresholdgenerating part shown in FIG. 5;

FIG. 10 shows a block diagram of one example of an image data changedetecting part according to the present invention;

FIGS. 11A and 11B typically show an original image and an image havingundergone the processing according to the present invention;

FIG. 12 shows one example of a dither threshold table for quantizationthreshold generation according to the present invention;

FIG. 13 shows a block diagram of one example of a general-purposecomputer by which the present invention can be achieved;

FIG. 14 shows a general configuration of a digital copier according tothe present invention;

FIG. 15 shows a block diagram of one example of a circuit portion of thedigital copier, shown in FIG. 14, in a simplified manner;

FIG. 16 shows a block diagram of another example of an image processingapparatus according to the present invention;

FIG. 17 shows one example of an error diffusion matrix according to thepresent invention;

FIG. 18 show differential filters for edge detection according to thepresent invention;

FIGS. 19, 20, 21, 22 and 23 shows other examples of dither thresholdtables (dither threshold matrixes) for quantization threshold generationaccording to the present invention;

FIG. 24 shows a block diagram of another example of a quantizationthreshold generating part according to the present invention;

FIGS. 25A, 25B and 25C show other examples of dither threshold matrixescorresponding to specified modes (FIG. 25A: photograph mode; FIG. 25B:character/photograph mode; and FIG. 25C: character mode) according tothe present invention;

FIG. 26 shows a block diagram of another example of a circuit portion ofthe digital copier according to the present invention, in a simplifiedmanner;

FIGS. 27A and 27B show other examples of dither threshold matrixes forquantization threshold generation according to the present invention;

FIG. 28 shows an order of output dot generation for image flat portions,when the dither threshold matrix shown in FIG. 27A is used, according tothe present invention;

FIG. 29 shows a quantization thresholds generated for image flatportions, when the dither threshold matrix shown in FIG. 27A is used,according to the present invention;

FIGS. 30, 31 and 32 show states of development of output dots for alow-shade portion, a medium-shade portion and a high-shade portion,respectively, when the dither threshold matrix shown in FIG. 27A isused, according to the present invention;

FIG. 33 shows an ordinary error diffusion processing direction;

FIG. 34 shows another error diffusion processing direction;

FIG. 35 shows an order of output dot generation for image flat portionsin the case of the direction shown in FIG. 34, when the dither thresholdmatrix shown in FIG. 27B is used, according to the present invention;

FIG. 36 shows a quantization thresholds generated for image flatportions in the case of the direction shown in FIG. 34, when the ditherthreshold matrix shown in FIG. 27B is used, according to the presentinvention;

FIG. 37 shows another example of a dither threshold matrix forquantization threshold generation according to the present invention;

FIGS. 38, 39 and 40 show states of development of output dots for alow-shade portion, a medium-shade portion and a high-shade portion,respectively, when the dither threshold matrix shown in FIG. 37 is used,according to the present invention;

FIG. 41 shows another example of a dither threshold matrix forquantization threshold generation according to the present invention;

FIG. 42 shows quantization thresholds generated for an image flatportion when the dither threshold matrix shown in FIG. 41 is used;

FIGS. 43A, 43B and 43C show states of development of output dots for alow-shade portion, a medium-shade portion and a high-shade portion,respectively, when the dither threshold matrix shown in FIG. 41 is used,according to the present invention;

FIG. 44 shows another example of a dither threshold matrix forquantization threshold generation according to the present-invention;

FIG. 45 shows quantization thresholds generated for an image flatportion when the dither threshold matrix shown in FIG. 44 is used; and

FIG. 46 shows a block diagram of one example of a quantization thresholdgenerating part according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

With reference to the accompanying drawings, preferred embodiments ofthe present invention will now be described. For the sake of avoidingduplicated description, the same reference numerals are given to thesame parts/components or corresponding parts/components in a pluralityof drawings of the accompanying drawings.

A first embodiment of the present invention will now be described.

FIG. 1 shows a block diagram of an image processing apparatus in thefirst embodiment of the present invention.

The image processing apparatus quantizes multi-tone image data 100 andoutputs 2-bit image data 101.

The image processing apparatus includes an error diffusion processingpart 110, an image data change detecting part 120, a quantizationthreshold generating part 130, a signal delaying part 140 for timingadjustment between the error diffusion processing part 110 and the otherparts. The signal delaying part 140 is provided as the necessity arises,and includes a predetermined number (line number) of line memories, forexample.

In this embodiment, it is assumed that the image data 100 is 8-bit data.

The error diffusion processing part 110 uses a quantization thresholdgenerated by the quantization threshold generating part 130, andquantizes input image data into two-level data.

As shown in FIG. 1, the error diffusion processing part 110 includes acomparator (quantizer) 111, an error calculating part 112, an errorstoring part 113, a diffusion error calculating part 114, and an erroradding part 115.

Multi-tone image data input via the signal delaying part 140 is input tothe comparator after having diffusion error data added thereto by theerror adding part 115.

The comparator 111 outputs “1” when input image data is equal to orlarger than the quantization threshold, and outputs “0” in the othercases, as image data 101.

The error calculating part 112 calculates an error between the imagedata input to the comparator 111 and the image data 101 output from thecomparator 111.

Because the image data processed here is 8-bit image data, “1” of theoutput image data 101 is processed as 255 (decimal notation) and “0” as0 (decimal) in the error calculation.

The calculated error is written to the error storing part 113. The errorstoring part 113 is used for storing error data concerning alreadyprocessed pixels surrounding a target pixel. Because diffusion is madeup to the pixel two lines ahead of the target pixel in this embodiment,three line memories for three lines, for example, are used as the errorstoring part 113.

The diffusion error calculating part 115 calculates an error amount tobe diffused to a subsequent target pixel from the error data stored inthe error storing part 113. In this embodiment, as shown in the insideof the block of the error storing part 113, the diffusion errorcalculating part 115 has coefficients (the total of which is 32)corresponding to 12 pixel positions a, b, c, . . . , k and 1 surroundinga pixel position * of a pixel processed immediately precedingly, andprovides a value obtained as a result of dividing by 32 the total ofvalues obtained by multiplying the error data corresponding to those 12pixel positions by the corresponding coefficients, respectively, as theerror diffusion amount for the subsequent target pixel, to the erroradding part 115. The method of calculating the diffusion error amountmay be appropriately changed.

The image data change detecting part 120 detects change of the imagedata 100, and detection data thereof is used by the quantizationthreshold generating part 130 for controlling an oscillation range ofthe quantization threshold.

In this embodiment, the image data change detecting part 120 detects anedge degree of the image data 100, and outputs the detected edge degreeas 4-bit detection data which may vary from a level 0 (non edge) to alevel 8 (maximum edge degree).

Further specifically, 4 types of differential filters shown in FIGS. 2A,2B, 2C and 2D are used, respective edge amounts for four directions,i.e., a main scanning direction, a sub-scanning direction, anddirections ±45° oblique from the main scanning direction, are detected,the one, the absolute value of which is the largest, is selected fromthe detected four edge amounts, and the absolute value of the selectededge amount is encoded into detection data representing the edge degreewhich may vary 9 levels from the level 0 to the level 8. The method ofdetecting the edge degree may be appropriately changed.

A method of detecting the edge amount by using the differential filtersshown in FIGS. 2A through 2D is to obtain the total of values obtainedfrom multiplying image data of pixels surrounding a target pixel atpixel positions shown in each of the filters shown in FIGS. 2A through2D by the corresponding coefficients shown in the figures, respectively,for example.

The quantization threshold generating part 130 generates thequantization threshold which oscillates cyclically in image space withthe oscillation range controlled according to the detection data fromthe image data change detecting part 120, and provides the quantizationthreshold to the comparator 111 of the error diffusion processing part110.

In the present embodiment, the quantization threshold generating part130 includes, as shown in FIG. 3, a fluctuating value generating part131 generating a fluctuating value oscillating cyclically in imagespace, a multiplying part 132 multiplying the fluctuating value by amultiplication factor according to the edge degree provided, and anadding part 133 adding a fixed value to the fluctuating value obtainedas a result of being multiplied by the multiplying part 132.

The fluctuating value generating part 131 uses a 4×4 dither thresholdtable such as that shown in FIG. 4, in which the coefficient thereofincreases from −7 to +8 spirally from the center thereof, for example.This table is applied to each set of pixels of an original image so asto cover the entire area of the original image. Then, theabove-mentioned coefficients of the dither threshold table are read outaccording to target-pixel positions. Thereby, the fluctuating valuegenerating part 131 generates the fluctuating value which oscillatesbetween −7 and +8 cyclically in the image space.

This fluctuating value generating part 131 can be easily achieved byusing a ROM storing the dither threshold table, counters counting timingpulses in the main and sub-scanning of the image data so as to generatereading addresses for the ROM, and so forth.

The multiplying part 132 multiplies the fluctuating value by themultiplication factor 8 when the edge degree represented by thedetection data from the image data change detecting part 120 is thelevel 0 (non edge), the multiplication factor 7 when the edge degree isthe level 1, the multiplication factor 6 when the edge degree is thelevel 2, the multiplication factor 5 when the edge degree is the level3, the multiplication factor 4 when the edge degree is the level 4, themultiplication factor 3 when the edge degree is the level 5, themultiplication factor 2 when the edge degree is the level 6, themultiplication factor 1 when the edge degree is the level 7 and themultiplication factor 0 when the edge degree is the level 8 (maximumedge degree).

Accordingly, the output value of the multiplying part 132 oscillateswith the maximum oscillation range between +64 and −56 when the edgedegree is the level 0. The fixed value added by the adding part 133 isselected to be +128 (decimal) which is the medium value of the range ofthe image data.

Thereby, the quantization threshold provided to the comparator 111oscillates around the oscillation center of 128, and the maximumoscillation range thereof is 120 (between +192 and −72) when the edgedegree is the level 0.

By the above-described configuration, for a portion in an image in whichchange of image data is sharp (where the edge degree is high level) suchas an edge portion of a character or a line drawing, for example, theedge degree thereof is the maximum level 8, the quantization thresholdis fixed to +128. Thereby, a true or pure error diffusion method is usedfor quantization using the fixed threshold in the error diffusionprocessing part 110.

As the level of the edge degree decreases, the oscillation range of theoscillation component added to the quantization threshold increases.Thereby, the processing performed by the error diffusion processing part110 changes from the processing mainly according to error diffusion intothe processing mainly according to dithering.

Then, when the oscillation range of the quantization threshold becomesmaximum for a flat portion of an image where the edge degree is thelevel 0.

Thus, for a portion of an image in which change in image data is largesuch as a character or a line drawing, high resolution processing mainlyby error diffusion technique is performed. In contrast to this, for aflat portion or a photograph, high graininess, stable processing mainlyby dithering technique in which dots are concentrated is performed.

Further, in a boundary between portions of both types, the oscillationrange of the quantization threshold changes gradually according to theedge degree. Thereby, the characteristics of the processing are smoothlyswitched from the processing mainly according to the error diffusiontechnique to the processing mainly according to the dithering technique,and vise versa.

Accordingly, when the output image data 101 of the error diffusionprocessing part 110 is provided to an image forming apparatus such as anelectrophotographic printer or the like, it is possible to form a highquality image having high resolution at a portion in which change inimage data is sharp such as a character or a line drawing, being smoothand stable at a portion in which change in image data is gentle such asa photograph, and, also, having no incongruity at a boundary betweenportions of both types.

In particular, in order to obtain a high quality in a printed image byan electrophotographic printer for an image flat portion, it iseffective to oscillate image data in an oscillation range sufficientlylarger in ratio to the range of image data at a low frequency. From thispoint of view, it is generally preferable to select a value equal to orlarger than ⅓ the range of image data as the maximum oscillation rangeof the quantization threshold (in the case where the edge degree is thelevel 0), and the present embodiment satisfies this condition.

Because the quantization threshold is caused to oscillate in theoscillation range according to the edge degree, the method in thepresent invention is different from that disclosed in Japanese PatentNo. 2801195 described above in which a dither signal is added to imagedata, there occurs no problem in that widening of the-operation range ofimage data is needed and so forth.

A second embodiment of the present invention will now be described.

According to the second embodiment of the present invention, thequantization threshold generating part 130 in the image processingapparatus shown in FIG. 1 has the configuration shown in FIG. 5. Theother configuration is the same as that shown in FIG. 1. However, theimage change detecting part 120 is changed so as to output 2-bitdetection data which can represent an edge degree of 4 levels from thelevel 0 to the level 3.

In the second embodiment, the quantization threshold generating part 130includes four threshold generating parts 131_0 through 130_3 whichgenerate fluctuating values having oscillation ranges corresponding tothe respective levels 0 through 3 of the edge degree, respectively, anda selecting part 134 which selects one of the fluctuating valuesgenerated by the threshold generating parts 131_0 through 130_3according to the detection data input from the image data changedetecting part 120.

The threshold generating part 131_0 generates the fluctuating valuefluctuating cyclically in image space with the largest oscillationrange. The threshold generating part 131_1 generates the fluctuatingvalue with the oscillating range smaller than that of the thresholdgenerating part 131_0. The threshold generating part 131_2 generates thefluctuating value with the oscillating range smaller than that of the *threshold generating part 131_1. The threshold generating part 131_3generates the fluctuating value with the smallest oscillating range.

Each of these threshold generating parts may have the same configurationas that of the fluctuating value generating part 131 of theabove-described first embodiment except the dither thresholds. In thesecond embodiment, the threshold generating parts 131_0 through 130_3use the dither threshold tables shown in FIGS. 6, 7, 8 and 9,respectively, for example. These dither threshold tables are obtained asa result of each value of the dither threshold table shown in FIG. 12being multiplied by 8, 5, 2 and 0, respectively, and then 128 beingadded thereto.

When the edge degree is the level 0, the selecting part 134 selected thefluctuating value having the largest oscillation range generated by thethreshold generating part 131_0, and is provided to_the comparator 111as the quantization threshold.

Similarly, when the edge degree is one of the levels 1, 2 and 3, theselecting part 134 selects the fluctuating value generated by therespective one of the threshold generating parts 131_1, 131_2 and 131_4,and is provided to comparator 111 as the quantization threshold.

Thereby, also in the second embodiment, for a region in which the edgedegree is the maximum level, the quantization threshold is fixed to 128.Further, the largest oscillating range (for the case where the edgedegree is the level 0) of the quantization threshold is selected to beequal to or larger than ⅓ the range of image data, same as in the firstembodiment.

Accordingly, also in the second embodiment, same as in the firstembodiment, processing mainly according to the error diffusiontechnology having high resolution is performed for portions ofcharacters and line drawings, while processing mainly according to thedithering technology having superior graininess and stability isperformed for portions such as photographs having a little change inimage data. Accordingly, it is possible to reproduce high quality imagesas in the first embodiment.

Further, in the second embodiment, it is possible to eliminate a partfor multiplication processing (corresponding to the multiplying part 132shown in FIG. 3) which is disadvantageous in view of costs andprocessing time whether the quantization threshold generating part 130is achieved by hardware or software, and a part for adding a fixed value(corresponding to the adding part 133 shown in FIG. 3). Accordingly, inparticular in a case where the number of edge degree levels is small,i.e., on the order of 4, as in the second embodiment, the memory amountneeded for the threshold generating dither threshold tables is small,and, thereby, high-speed processing can be easily achieved byconfiguring the arrangement by hardware.

A third embodiment of the present invention will now be described.

According to the third embodiment of the present invention, the imagedata change detecting part 120 in the image processing apparatus shownin FIG. 1 has the configuration shown in FIG. 10. The otherconfiguration is the same as the above-described first embodiment.

The image data change detecting part 120 shown in FIG. 10 includes anedge detecting part 121, and a region expansion processing part 122 fordetecting cyclicity of change of image data (determining a halftone-spotimage having the number of halftone spots per area falling in apredetermined range).

As described above with regard to the first embodiment, the edgedetecting part 121 uses differential filters such as those shown inFIGS. 2A through 2D, and detects edge amounts for four directions, andoutputs the maximum (absolute value) thereof as edge, data representingthe edge degree in the range from the level 0 (non-edge) to the level 8(maximum edge degree) for example.

The region expansion processing part 122 performs region expansion inimage space on the edge data provided by the edge detecting part 121.Specifically, for example, the edge data in a region of 7×7 pixelssurrounding (three pixels each of before and after in the main scanningdirection and three pixels each of before and after in the sub-scanningdirection) a target pixel is referred to, and the maximum thereof isselected as the edge data of the target pixel. The selected edge data isoutput as the detection data from the image data change detecting part120.

When image data 100 is read in resolution of 600 dpi from an originalimage, an expansion extent of the above-mentioned 7 pixels of the regionexpansion processing is approximately 0.3 mm on the original image, andthis corresponds to the halftone-spot occurrence cycles per inch ofapproximately 86 Lpi (lines per inch). Accordingly, through the regionexpansion processing, for a coarse halftone-spot image lower than 86Lpi, a portion determined as an edge by the edge detecting part 121 isevaluated as an edge, while a fine halftone-spot image equal to orhigher than 86 Lpi is evaluated as an edge.

Thereby, for a peripheral portion of each halftone spot of a coarsehalftone-spot image portion lower than 86 Lpi, processing mainlyaccording to the error diffusion technique using a fixed quantizationthreshold or a oscillating quantization threshold with a smalloscillation range. Accordingly, it is possible to reproduce halftonespots faithfully with high resolution, and to prevent moiré pattern frombeing generated.

For a fine halftone-spot image portion equal to or higher than 86 Lpi,also processing mainly according to the error diffusion technique usinga fixed quantization threshold or a oscillating quantization thresholdwith a small oscillation range. Accordingly, it is possible to reproducehalftone spots faithfully with high resolution, and to prevent moirépattern from being generated.

However, for a further fine halftone-spot image portion equal to orhigher than 175 Lpi, halftone-spot components are not left in the imagedata 100 through previous smoothing processing as will be describedlater, and, thereby, same as for flat portions of image, processingmainly according to the dithering technique using an oscillatingquantization threshold in a large oscillation range having superiorgraininess and stability is performed, and, halftone spots are producedin 150 Lpi which is the dither threshold cyclicity of the ditherthreshold table shown in FIG. 4 when this dither threshold table is usedfor the processing. Accordingly, satisfactory graininess is obtained,and banding or shade unevenness is not likely to be generated.

Thus, in the third embodiment, it is possible to reproduce an imageincluding characters, line drawings, halftone spots, and so forth, withhigh image quality.

What affects sharpness of images is image-data changing points, and, itis generally possible to produce high-quality images when relativelycoarse halftone spots up to the order of 50 Lpi can be faithfullyreproduced. Accordingly, even though, strictly speaking, it is necessaryto consider influence of MTF characteristics of a scanner used forreading an original image, characteristics of the edge detectingfilters, cycle difference occurring due to shade change of halftone-spotimage and so forth, it is generally possible to reproduce halftone-spotimages with sufficient image quality when the expansion extent of theregion expansion processing is selected to be equal to or smaller than0.5 mm in image space.

Image data obtained from scanning an original image by a scanner andreading it is caused to pass through a smoothing filter for representinghalftone smoothly. Thereby, ordinarily, smoothing is effected for arange from the order of 150 Lpi. Accordingly, cyclicity amplitude ofoscillation of halftone spots finer than the order of 175 Lpi through200 Lpi is not left unsmoothed. Therefore, moiré pattern is not likelyto be generated even when such a fine halftone-spot image portion istreated as a non-edge portion and is caused to undergo processing mainlyaccording to the dithering technique.

FIGS. 11A and 11B typically show an example of original image andprocessed image. FIG. 11A shows an original image including a rectanglehaving a halftone shade therein, which is determined as an image flatportion, and an edge portion separately by the edge detectingprocessing, and a level of edge degree is determined for the edgeportion.

The flat portion of the original image is caused to undergo processingmainly according to the dithering technique with the quantizationthreshold oscillating in the largest oscillation range. Accordingly theflat portion is represented by halftone spots at the dither thresholdcycles, as shown in FIG. 11B.

On the other hand, the rectangle contour portion which is the edgeportion is caused to undergo processing mainly according to the errordiffusion technique. Accordingly, a high-resolution contour shape isreproduced as in the general error diffusion process.

Actually, because the region expansion processing is performed, aportion including equal to or more than surrounding seven pixels of theedge portion is represented by isolated dots.

In the third embodiment, halftone-spot image portions havinghalftone-spot occurrence cycles per inch falling in a specific range aredistinguished. However, it is also possible that a part of detectinghalftone-spot image portions having halftone-spot occurrence cycles perinch falling in a specific range is especially provided, and, for thehalftone-spot image portions having halftone-spot occurrence cycles perinch falling in the specific range detected thereby, the quantizationthreshold generating part 110 generates a non-oscillating quantizationthreshold or an oscillating quantization threshold in a smalloscillation range, regardless of the edge degree detected by the edgedetecting part 121, and performs processing mainly according to theerror diffusion technique.

A fourth embodiment of the present invention will now be described.

In the fourth embodiment, the quantization threshold generating part 130has the configuration shown in FIG. 5 described in the description ofthe second embodiment, in the general configuration according to theabove-described third embodiment. However, in the fourth embodiment, theedge detecting part 121 of the image data change detecting part 120(FIG. 10) is changed to output 2-bit edge data representing an edgedegree which may vary in four levels from a level 0 to a level 3.Accordingly, the region expansion processing part 122 outputs 2-bitdetection data.

The region expansion processing part 122 needs to store edge data of atarget pixel and pixels surrounding the target pixel. In the fourthembodiment, the edge data is reduced from 4-bit data into 2-bit data.Accordingly, the necessary memory capacity of line memories or the likefor storing it is halved.

A fifth embodiment of the present invention will now be described.

In the fifth embodiment, the fluctuating value generating part 131 ofthe quantization threshold generating part 130 uses the dither thresholdtable shown in FIG. 12, in the general configuration according to theabove-described first embodiment or third embodiment.

The dither threshold table shown in FIG. 12 having the 8×8 pixel size isobtained as a result of the 4×4 dither threshold table shown in FIG. 4being modified. The dithering cycle is of 150 Lpi the same as that ofthe table shown in FIG. 4. However, according to the dither thresholdtable shown in FIG. 12, resulting halftone spots are arranged in adirection of 63.5°. Accordingly, this dither threshold table is suitedfor error diffusion processing.

In each of the above-described embodiments, it is possible to provide aplurality of quantization threshold generating parts 130, to cause themto generate a plurality of quantization thresholds, cause the comparator111 of the error diffusion processing part 110 to compare the image datawith each of these quantization thresholds, and, thereby, to performmulti-level quantization of more than two levels.

Each of the above-described embodiments may be achieved by softwareusing a general-purpose computer such as that shown in FIG. 13.

In this case, a program for achieving the functions of the respectiveparts of the image processing apparatus is read from one of variousrecording media such as a floppy disk, an optical disk, amagneto-optical disk, a semiconductor storage device, and so forththrough a drive device, or received from an external computer via anetwork through a communication device, is then loaded in a main memory,and is then executed by a CPU.

Accordingly, it is possible to achieve the image processing apparatus bythe general-purpose computer. Storage areas of the main memory may beused as line memories and so forth necessary for storing signals, andsignal delay, for example.

Such various computer-readable recording media (floppy disk, opticaldisk, magneto-optical disk, semiconductor storage device, and so forth)in which such a program is recorded are included in the presentinvention.

The image processing apparatus in each of the above-describedembodiments may be incorporated in apparatuses relating to imageformation such as a printer, a display and so forth, apparatusesrelating to image reading such as a scanner, a facsimile machine, and soforth, and apparatuses relating both to image reading and imageformation such as digital copier and so forth.

As one example thereof, a digital copier to which the present inventionis applied will now be described (as a sixth embodiment of the presentinvention).

FIG. 14 shows a general sectional view of the digital copier in thesixth embodiment.

The digital copier shown in FIG. 14 includes an image reading part 400which optically scans an original image and reads it, a laser printer411 which serves as an image forming apparatus, and a circuit part 550(see FIG. 15) not shown in the figure.

The image reading part 400 illuminates an original image sheet placed ona flat original table 403 by an illuminating lamp 502, forms an imagefrom a thus-reflected light image onto an image sensor 507 such as a CCDby mirrors 503 through 505 and a lens 506. And also, by sub-scanning theoriginal image sheet by moving the illuminating lamp 502 and mirrors 503through 505, the image reading part 400 reads image information of theoriginal image sheet, and converts it into an electric image signal. Theanalog image signal output from the image sensor 507 is input to thecircuit part 550 (FIG. 15), and is processed thereby. Image data outputfrom the circuit part 550 is input to the laser printer 411.

In the laser printer 411, a writing optical unit 508 converts image datainput from the circuit part 550 into an optical signal, and exposes animage carrying body made of a photosensitive body, for example, aphotosensitive body drum 509. Thereby, an electrostatic latent imagecorresponding to the original image is formed on the photosensitive bodydrum 509.

The writing optical unit 508, for example, drives a semiconductor laseraccording to the above-mentioned image data so as to cause it to emit athus-intensity-modulated laser light, deflects the laser light by arotational polygon mirror 510, and illuminates the photosensitive bodydrum 509 by the laser light through an f/θ lens and a reflective mirror511.

The photosensitive body drum 509 is driven to rotate in a directionindicated by the arrow clockwise by a driving part. When being chargeduniformly by a charger 512, the photosensitive body drum 509 is exposedby the writing optical unit 508, and thus has the electrostatic latentimage formed thereon.

The electrostatic latent image on the photosensitive body drum 509 isdeveloped by a developing device 513, and becomes a toner image.Further, a paper sheet is supplied by any of a plurality of paperfeeding parts 514 through 518 and hand-inserting paper feeding part 519to a registration roller 520. The registration roller 520 sends out thepaper sheet in timing to the toner image on the photosensitive body drum509.

A transfer belt 521 has a transfer bias applied thereto by a transferpower source, transfers the toner image on the photosensitive body drum509 onto the paper sheet, and carries the paper sheet. The paper sheethaving had the toner image transferred thereto is then carried to afixing part 522 by the transfer belt 521, and the toner image is fixedonto the paper sheet, which is then ejected to an ejecting tray 523.

The photosensitive body drum 509 is cleaned by a cleaning device 524after the toner image thereon is transferred, and electricity of thephotosensitive body drum 509 is removed by an electricity removal device525. Thus, the photosensitive body drum 509 is prepared for a subsequentimage forming operation.

FIG. 15 shows a block diagram after simplifying one example of thecircuit part 550 of the digital copier.

Input to the circuit part 550 is, for example, an analog image signalobtained from reading the original image in 600 dpi by the image sensor507 of the image reading part 400. The level of this analog signal isadjusted by an AGC circuit 551, and, then, an A-D converting circuit 552converts the thus-obtained analog signal into a digital image signalrepresenting each pixel by 8 bits.

Further, a shading correction circuit 553 corrects for each pixel of theimage sensor 507 variation in sensitivity and illumination.

Then, the image data is sent to a filter processing circuit 554,undergoes MTF correction, for example, and then, undergoes smoothingfilter processing for representing a halftone image smoothly. Throughthe smoothing filter processing, fine halftone-spot components finerthan the order of 150 Lpi are smoothed, and, thereby, fine halftone-spotcomponents equal to or finer than 175 Lpi are almost completely removed.

The thus-obtained image data is input to the image data change detectingpart 120 described above in the description of the first through fifthembodiments, and, also, is input to a γ (gamma) correction circuit 555which then performs γ correction on the input image data for convertingthe shades of the image data into writing shades. The image data havingundergone the γ correction is input to the error diffusion processingpart 110 (FIG. 1) via the signal delaying part 555 described in thedescription of the first through fifth embodiments.

Detection data output from the image data change detecting part 120 isinput to the quantization threshold generating part 130 described in thedescription of the first through fifth embodiments, and the quantizationthreshold is provided to the comparator 111 (FIG. 1) of the errordiffuison processing part 110 from the quantization threshold generatingpart 130. The output data of the comparator 111 is sent to the lightemitting drive control part of the semiconductor laser in the writingoptical unit 508.

In the error diffusion processing part 110, the processing according toany of the above-described embodiments is performed on the image data.Accordingly, it is possible to reproduce the image read from theoriginal image sheet with high image quality.

Actually, the digital copier can perform processing such as image-sizechanging processing, background removal processing, flare removalprocessing, other image edition processing on image data. However,description thereof is omitted. Further, the digital copier in the sixthembodiment has the functions of both image reading and image formation.Accordingly, description of image processing apparatuses such as ascanner, a printer, a facsimile machine and so forth to which thepresent invention is applied to is omitted.

A seventh embodiment of the present invention will now be described.

FIG. 16 shows a block diagram of an image processing apparatus in theseventh embodiment of the present invention.

This image processing apparatus receives multi-tone image data 1100, andoutputs quantized data 1101 thereof. The image processing apparatusincludes an error diffusion processing part (quantization processingpart) 1120, an image characteristics extracting part 1130, aquantization threshold generating part 1140 and a signal delaying part1150 which adjusts timing of the error diffusion processing part 1120and image characteristics extracting part 1130.

The signal delaying part 1150 is provided as necessity arises, and,includes a desired numbers (line numbers) of line memories, for example.

The input image data 1100 is 8-bit image data read in 600 dpi by ascanner, for example. Generally, such image data 1100 is input afterpassing through a smoothing filter for expressing halftone smoothly.Ordinarily, as mentioned above, smoothing is performed for image cyclesper inch from the order of 150 Lpi. Accordingly, the image data 1100does not have high-cycle-per-inch components equal to or higher than 175Lpi of a high-cycle-per-inch halftone-spot image used in gravureprinting, left therein.

The error diffusion processing part 1120 uses a quantization thresholdgenerated by the quantization threshold generating part 1140, andquantizes input image data by error diffusion method.

As shown in FIG. 16, in the seventh embodiment, the error diffusionprocessing part 1120 includes a quantizer (comparator) 1121, an errorcalculating part 1122, an error storing part 1123, an error diffusionmatrix part 1124, and an error adding part 1125.

Image data 1100 has timing thereof adjusted by the signal delaying part1150 and is input to the error adding part 1125. The image data havinghad a diffusion error added thereto by the error adding part 1125 isinput to the quantizer 1121. The quantizer 1121 quantizes the inputimage data using the quantization threshold given by the quantizationthreshold generating part 1140, and outputs the quantization result asquantized data 1101.

For the sake of simplification of description, it is assumed that thequantization threshold generating part 1140 generates a singlequantization threshold, and, the quantizer 1121 outputs “1” when theinput image data is equal to or larger than the quantization thresholdeach time, and outputs “0” in the other cases, as 1-bit quantized imagedata 1101. However, it is not necessary to be limited thereto. Forexample, the quantization threshold generating part 1140 may generatethree quantization thresholds, the quantizer 1121 may use thesequantization thresholds and quantize the input image data into 4 levels,and may output 2-bit quantized image data 1101.

The error calculating part 1122 calculates the quantization error of thequantizer 1121. Because the image data processed here is 8-bit imagedata, “1” of the output image data 1101 is processed as 255 (decimalnotation) and “0” as 0 (decimal) in this error calculation, for example.

The calculated quantization error is temporarily stored in the errorstoring part 1123. The error storing part 1123 is used for storing errordata concerning already processed pixels surrounding a target pixel.Because diffusion is made up to the pixel two lines ahead of the targetpixel in this embodiment, two line memories for two lines, for example,are used as the error storing part 1123.

The error diffusion matrix part 1124 calculates the diffusion error tobe added to a subsequent target pixel from the quantization error datastored in the error storing part 1123. In this embodiment, as shown inFIG. 17, an error diffusion matrix having a size of three pixels in thesub-scanning direction and five pixels in the main scanning direction isused, and the diffusion error data is calculated.

In FIG. 17, * corresponds to the position of the subsequent targetpixel, and a, b, c, . . . , k and 1 are coefficients (the total of whichis 32) corresponding to the positions of surrounding already processed12 pixels. The error diffusion matrix part 1125 provides a valueobtained as a result of dividing by 32 the total of values obtained frommultiplying the respective quantization errors concerning those alreadyprocessed 12 pixels by the corresponding coefficients ‘a’ through ‘1’,respectively, as the diffusion error for the subsequent target pixel, tothe error adding part 1125.

The image characteristics extracting part 1130 includes an edgedetecting part 1131 and a region expansion processing part 1132.

The edge detecting part 1131 detects an edge degree of the image data1100, and outputs the detected edge degree as 4-bit detection data whichmay vary from a level 0 (maximum edge degree) to a level 8 (non edge).

Further specifically, 4 types of 5×5 differential filters shown in FIG.18 are used, respective edge amounts for four directions, i.e., the mainscanning direction, sub-scanning direction, and directions ±45° obliquefrom the main scanning direction, are detected, the one, the absolutevalue of which is the largest, is selected from the detected four edgeamounts, and the absolute value of the selected edge amount is quantizedinto detection data representing the edge degree which may vary 9 levelsfrom the level 0 to the level 8.

A method of detecting the edge amount by using the differential filtersshown in FIG. 18 is to obtain the total of values obtained frommultiplying respective image data for pixels surrounding a target pixelat pixel positions shown in each of the filters shown in FIG. 18 by thecorresponding coefficients shown in the figures, respectively, forexample.

The region expansion processing part 1132 performs region expansionprocessing of the extent of 7 pixels on the edge data provided by theedge detecting part 1131. Specifically, for example, the edge data in aregion of 7×7 pixels surrounding (three pixels each of before and afterin the main scanning direction and three pixels each of before and afterin the sub-scanning direction) the target pixel provided by the edgedetecting part 1131 is referred to, and the minimum edge level (maximumedge degree) thereof is selected as the edge level of the target pixel.The selected edge level is output as 4-bit edge data. This edge data isgiven to the quantization threshold generating part 1140.

In the present embodiment, the quantization threshold generating part1140 generates the quantization threshold which cyclically oscillates inimage space in the oscillation range according to the edge levelexpressed by the edge data output from the region expansion processingpart 1132, and provides the quantization threshold to the quantizer 1121of the error diffusion processing part 1120. The quantization thresholdgenerating part 1140 includes a fluctuating value generating part(dither threshold generating part) 1141, a multiplying part 1142multiplying the output value of the fluctuating value generating part1141 by a multiplication factor (0 through 8) corresponding to the edgelevel indicated by the edge data, and an adding part 1143 adding a fixedvalue to the output value of the multiplying part 1142.

The fluctuating value generating part 1141 uses a dot-concentration 4×4dither threshold table such as that shown in FIG. 19, in whichthresholds from −7 to +8 around 0 are arranged so that these thresholdsincrease spirally from the center thereof, for example. This table isapplied to each set of pixels of an original image so as to cover theentire area of the original image. Then, the above-mentionedcoefficients of the dither threshold table are read out according totarget-pixel positions. Thereby, the fluctuating value generating part1141 generates the fluctuating value which oscillates between −7 and +8cyclically in the image space.

The dither threshold cycle is 4 pixels which corresponds to 150 Lpi in acase where image formation of 600 dpi.

This fluctuating value generating part 1141 can be easily achieved byusing a ROM storing the dither threshold table, counters counting timingpulses in the main and sub-scanning of the image data so as to generatereading addresses for the ROM, and so forth.

The multiplying part 1142 multiplies the fluctuating value by themultiplication factor 8 when the edge degree represented by thedetection data from the image data change detecting part 120 is thelevel 8 (non edge), the multiplication factor 7 when the edge degree isthe level 7, the multiplication factor 6 when the edge degree is thelevel 6, the multiplication factor 5 when the edge degree is the level5, the multiplication factor 4 when the edge degree is the level 4, themultiplication factor 3 when the edge degree is the level 3, themultiplication factor 2 when the edge degree is the level 3, themultiplication factor 1 when the edge degree is the level 1 and themultiplication factor 0 when the edge degree is the level 1 (maximumedge degree).

Accordingly, the output value of the multiplying part 1142 oscillates inthe maximum oscillation range between +64 and −56 when the edge degreeis the level 8 (non edge). The fixed value added by the adding part 1143is selected to be +128 (decimal) which is the medium value of the rangeof the image data.

Accordingly, the quantization threshold provided to the quantizer 1121oscillates around +128, and the maximum oscillation range thereof is 120(between +192 and −72).

When the quantized data 1101 of the thus-configured image processingapparatus is provided to an electrophotographic printer, it is possibleto produce high-grade images, at high resolution for image-data changingpoints or halftone-spot images of relatively low halftone-spot cyclesper inch (coarse halftone-spot images), smooth and stable forphotographs, portions in which image data changes gently, orhalftone-spot images of high halftone-spot cycles per inch (finehalftone-spot images), and in which these different regions match eachother without sense of incongruity.

Specifically, for a portion in an image in which change of image data issharp and the edge level is the level 0 (where the edge degree ishighest) such as an edge portion of a character or a line drawing, thequantization threshold generated by the quantization thresholdgenerating part 1140 is fixed to +128. Thereby, a true or pure errordiffusion method is used for quantization using the fixed threshold inthe error diffusion processing part 1120. Accordingly, it is possible toform a high-resolution image.

For a portion such as a photograph or a flat portion of an image inwhich the edge degree is low (the edge level is high), the oscillationrange of the quantization threshold generated by the quantizationthreshold generating part 1140 is large. Accordingly, the quantizationprocessing of the error diffusion processing part 1120 is processingmainly according to the dithering technique in which dots areconcentrated. Thereby, the image data is converted to form halftonespots at the dither threshold cycles, and an image based on ditheringhaving superior graininess and stability is formed.

Further, because the halftone-spot cycles per inch are selected to 150Lpi in which the cyclicity is not remarkable to the human eyes, it ispossible to form smooth and high-grade images.

In the image processing apparatus in the seventh embodiment, positionsat which dots are generated shift due to diffusion of quantizationerrors. Accordingly, the dither threshold matrix merely controls the dotgeneration positions, and the dot generation positions may shift fromthe positions according to the arrangement of the thresholds in thedither threshold matrix. However, it has been confirmed that, when thedither threshold matrix such that halftone spots having an image spacefrequency (halftone-spot cycles per inch) in the range of 100 Lpithrough 250 Lpi are formed thereby is used by the dither thresholdgenerating part 1141 for image regions processed mainly according to thedithering technique, the cyclicity is not likely to be remarkable tohuman eyes, and, also, because dot concentration is performed in therange of resolution of electrophotographic printer and so forth, it ispossible to form smooth and high-grade images having a littledeformation of halftone spots and superior graininess.

Further, at the boundary between the region in which the edge degree ishigh and the region in which the edge degree is low, the oscillationrange of the quantization threshold changes gradually according to theedge degree. Thereby, the characteristics of the processing is smoothlyswitched from the processing mainly according to the error diffusiontechnique to the processing mainly according to the dithering technique,and vise versa. Accordingly, it is possible to form images in whichthere is no incongruousness in boundaries between both image regions.

The region expansion processing part 1132 of the image characteristicsextracting part 1130 performs region expansion processing of the extentof 7 pixels. In the case of 600 dpi, the expansion extent of theabove-mentioned 7 pixels of the region expansion processing correspondsto approximately 0.3 mm on the original image, and this corresponds tothe halftone-spot cycles per inch of approximately 86 Lpi (lines perinch). Accordingly, through the region expansion processing, a finehalftone-spot image higher than 86 Lpi is evaluated as an edge portion,and, therefor, processing mainly according to the error diffusiontechnique using a fixed quantization threshold or a oscillatingquantization threshold in a small oscillation range is performed in theerror diffusion processing part 1120. Thereby, it is possible toreproduce halftone spots faithfully with high resolution, and to preventmoiré patterns from being generated.

As described above, halftone-spot components of high halftone-spotcycles per inch equal to or higher than 175 Lpi are not left in thesmoothed image data 1100. Accordingly, for halftone-spot images of suchhigh halftone-spot cycles per inch, the edge level is the level 8 orhigh level (low edge degree). Thereby, they are processed mainlyaccording to the dithering technique using oscillating quantizationthreshold in a wide oscillation range same as for image flat portions.Thereby, they are converted into halftone spots at the dither thresholdcycles according to the halftone-spot cycles per inch of 150 Lpi.Accordingly, it is possible to form images superior in graininess andstability. Further, because halftone-spot components are removed fromthe image data 1100, no moiré patterns are generated.

For halftone-spot images of low halftone-spot cycles per inch lower than86 Lpi, halftone-spot boundary portions evaluated as edges are processedmainly according to the error diffusion technique using fixedquantization thresholds or oscillating quantization thresholds in narrowoscillation ranges. Accordingly, the halftone spots are reproducedfaithfully, and also, moiré patterns are prevented from being generated.Further, halftone-spot central portions not evaluated as edges areprocessed mainly according to the dithering technique using oscillatingquantization thresholds in wide oscillation ranges. Accordingly, it ispossible to express these portions with satisfactory stability andgraininess.

An eighth embodiment of the present invention will now be described.

In the eighth embodiment of the present invention, in an imageprocessing apparatus having the configuration shown in FIG. 16, thefluctuating value generating part 1141 of the dither thresholdgenerating part 1140 uses the 8×8 dither threshold matrix shown in FIG.20, and generates a dither threshold oscillating in image spacecyclically between −7 and +8. The other configuration is the same asthat of the above-described seventh embodiment.

The dither threshold matrix shown in FIG. 20 is obtained as a result ofthe 4×4 basic dither thresholds enclosed by the thick line (the same asthe dither threshold matrix shown in FIG. 19) being copied and four ofthem being combined, and thus the basic dither threshold matrix beingmagnified to a 8×8 size. In this arrangement, the basic dither matrixesadjacent in the main scanning direction are shifted in the sub-scanningdirection relatively by the half phase.

By using such a dither threshold matrix, for image flat portions forwhich processing mainly based on the dithering technique is performed,where halftone spots corresponding to 150 Lpi are formed in 600 dpi,because halftone-spot development starting points are arrangedstaggeringly, it is possible to form images superior in stabilityespecially for light-shade portions.

Further, halftone-spot arrangement is made with a screen angle ofapproximately 63.5°, such a dither threshold matrix is suited for errordiffusion processing, causes no deformation of halftone spots, andprovides satisfactory graininess.

Furthermore, when this dither threshold matrix is used, the cycle ofoccurrences of the halftone-spot development starting points is 4 pixelsin the sub-scanning direction while the same is 8 pixel in the mainscanning direction. This increases the stability of images because theintervals of on/off of dots in light-shade image flat portions are long.

The dither threshold generating part 1141 does not necessarily need tohave a ROM storing the 8×8 dither threshold matrix shown in FIG. 20, butmay have a ROM storing the 4×4 dither threshold matrix, and may generatethe thresholds of the 8×8 dither threshold matrix by controlling readingaddresses.

A ninth embodiment of the present invention will now be described.

In the ninth embodiment, in an image processing apparatus having theconfiguration shown in FIG. 16, the fluctuating value generating part1141 of the dither threshold generating part 1140 uses the 4×4 ditherthreshold matrix shown in FIG. 21 in which the thresholds from −7 to +8are arranged in a manner such that the threshold increases in thesub-scanning direction, and generates a dither threshold oscillating inimage space cyclically between −7 and +8. The other configuration is thesame as that of the above-described seventh embodiment.

By using such a dither threshold matrix, in image flat portions or thelike processed based on the dithering technique, stable and smooth imageare formed by lines extending in the sub-scanning direction in 150 Lpias a result of dots being arranged continuously in the sub-scanningdirection through development of the dots at cycles corresponding to 150Lpi in 600 dpi.

A tenth embodiment of the present invention will now be described.

In the tenth embodiment, in an image processing apparatus having theconfiguration shown in FIG. 16, the fluctuating value generating part1141 of the dither threshold generating part 1140 uses the 4×8 ditherthreshold matrix shown in FIG. 22 in which the thresholds from −16 to+15 are arranged in a manner such that the threshold increases in thesub-scanning direction, and generates a dither threshold oscillating inthe image space cyclically between −16 and +15. The other configurationis the same as that of the above-described seventh embodiment.

By using such a dither threshold matrix, similarly as in theabove-described ninth embodiment, in image flat portions or the likeprocessed based on the dithering technique, stable and smooth images areformed by lines extending in the sub-scanning direction in 150 Lpi as aresult of dots being arranged continuously in the sub-scanning directionthrough development of the dots at cycles corresponding to 150 Lpi in600 dpi.

An eleventh embodiment of the present invention will now be described.

In the eleventh embodiment, in an image processing apparatus having theconfiguration shown in FIG. 16, the fluctuating value generating part1141 of the dither threshold generating part 1140 uses the 6×6 ditherthreshold matrix shown in FIG. 23, and generates a dither thresholdoscillating in image space cyclically between −9 and +8. The otherconfiguration is the same as that of the above-described seventhembodiment.

This 6×6 dither threshold matrix is obtained from copying the basicdither matrix enclosed by the broken line in FIG. 23 and combining twoof them in a manner such as to have the screen angle of 45°. For thesake of easy understanding of this arrangement relationship, four of the6×6 dither threshold matrixes are arranged in FIG. 23. In theabove-mentioned basic threshold matrix, the thresholds from −9 to +8 arearranged in a manner such that the threshold increases approximatelyspirally.

By using such a 6×6 dither threshold matrix, in image flat portions orthe like processed based on the dithering technique, where halftonespots corresponding to approximately 141 Lpi are formed in 600 dpi, thehalftone spots are arranged with the direction of 450. Such arrangementwith the direction of about 450 is not likely to be remarkable to humaneyes.

Further, even when 90° rotation processing is performed on the imagedata 1100 antecedent to the present image processing apparatus (or 90°rotation processing is performed on the quantized data 1101 subsequentto the present image processing apparatus), the direction of thearrangement of halftone spots does not change substantially. Thereby,impression provided from the image formed doe not change whether or notthe rotation processing is performed.

In a digital copier, a function is provided such that rotational sortingis performed instead of mechanical sorting. In the rotational sorting,when a plurality of pages of original images are copied for a pluralityof copies, the first copy thereof is printed out without rotationprocessing performed thereon, the subsequent copy is printed out with90° rotation processing performed thereon, the further subsequent copythereof is printed out without rotation processing performed thereon, .. . . Thus, rotation processing is performed alternately for each copy,and, also, the paper feeding direction is switched according to whetheror not rotation processing is performed.

When such rotational sorting is performed, it is not preferable thatimpression from the image differs whether or not rotation processing isperformed. According to the eleventh embodiment, the direction ofarrangement of halftone spots of image flat portions and so forth issubstantially uniform regardless of whether or not rotation processingis performed. Accordingly, a difference is not generated such as tocause incongruousness between a copied image having undergone rotationprocessing and a copied image not having undergone rotation processing,even rotational sorting is performed.

A twelfth embodiment of the present invention will now be described.

In the twelfth embodiment, in an image processing apparatus having theconfiguration shown in FIG. 16, the quantization threshold generatingpart 1140 has the configuration shown in FIG. 24.

Further, the image change detecting part 1131 of the imagecharacteristics extracting part 1130 (FIG. 16) is changed so as toquantize the edge amount into 2-bit edge data which can represent 4 edgelevels from the level 0 (the highest edge degree)to the level 3 (nonedge).

In the twelfth embodiment, the quantization threshold generating part1140 includes four threshold generating parts 1145_0 through 1145_3which generate fluctuating values having oscillation rangescorresponding to the respective levels 0 through 3 of the edge degree,respectively, and a selecting part 1146 which selects one of thesefluctuating values generated by the threshold generating parts 1145_0through 1145_3 according to the edge level indicated by the edge datainput from the image characteristics extracting part 1130, and providesthe selected fluctuating value to the quantizer 1121 of the errordiffuison processing part 1120 (FIG. 16) as the dither threshold.

The threshold generating part 1145_3 corresponding to the edge level 3(non edge) uses the dither threshold matrix obtained from multiplyingeach threshold of the dither threshold matrix used in any of theabove-described seventh, eighth, ninth, tenth and eleventh (FIGS. 19through 23) by 8, and then, adding 128 thereto, and generates thethreshold oscillating in the maximum oscillating range.

The threshold generating part 1145_2 corresponding to the edge level 2uses the dither threshold matrix obtained from multiplying eachthreshold of that dither threshold matrix in the above-describedembodiment by 5, and then, adding 128 thereto, and generates thethreshold oscillating in the smaller oscillating range.

The threshold generating part 1145_1 corresponding to the edge level 1uses the dither threshold matrix obtained from multiplying eachthreshold of that dither threshold matrix in the above-describedembodiment by 2, and then, adding 128 thereto, and generates thethreshold oscillating in the further smaller oscillating range.

The threshold generating part 1145_0 corresponding to the edge level 0(the highest edge degree) generates the fixed value (+128).

Accordingly, also in the twelfth embodiment, it is obvious that, thesame quantization threshold generating processing as that of any of theseventh, ninth, eighth, tenth and eleventh embodiments is performed,and, thereby, high-grade images can be formed.

In the twelfth embodiment, it is possible to eliminate a part formultiplication processing (corresponding to the multiplying part 1142shown in FIG. 16) which is disadvantageous in view of costs andprocessing time whether the quantization threshold generating part 1140is achieved by hardware or software.

Further, although the region expansion processing part 1132 needs totemporarily store the edge data for the plurality of lines correspondingto the region expansion extent, it is possible to reduce the capacity ofline memories or the like for the temporarily storage as the edge datais reduced to 2-bit data.

Furthermore, because the number of edge degree levels is small, i.e., 4,the memory amount needed for the threshold generating dither thresholdtables in the threshold generating parts 1145_0 through 1145_3 is small.

Further, although the storage capacity of the region expansionprocessing part 1132 is not reduced, it is also possible that the edgedetecting part 1131 outputs the nine edge levels, and the nine edgelevels are converted into four levels in the region expansion processingpart 1132 and are output therefrom.

A thirteenth embodiment of the present invention will now be described.

In the thirteenth embodiment, in an image processing apparatus havingthe configuration shown in FIG. 16, a mode signal (not shown in thefigure) is input externally to the fluctuating value generating part1141 of the quantization threshold generating part 1140. Then, thefluctuating value generating part 1141 switches a dither thresholdmatrix used for dither threshold generation according to a modeindicated by the mode signal.

For example, the fluctuating value generating part 1141 has the 4×4dither threshold matrix for ‘photograph mode’ such as that shown in FIG.25A, the 2×2 dither threshold matrix for ‘character/photograph mode’such as that shown in FIG. 25B and the 1×1 dither threshold matrix for‘character mode’ such as that shown in FIG. 25C, for example, andselects the dither threshold matrix corresponding to the mode specifiedby the mode signal. The dither threshold matrix shown in FIG. 25A is thesame as that shown in FIG. 19.

When the photograph mode is specified, the dither threshold matrix shownin FIG. 25A is selected. Accordingly, for non-edge portions, smoothimages superior in stability are formed by halftone spots having imagespace frequency of 150 Lpi in 600 dpi. Accordingly, this mode is suitedfor outputting images having a little change in image data such asphotographs.

When the character mode is specified, the dither threshold matrix shownin FIG. 25C is selected. Accordingly, the quantization threshold isfixed to +128, and quantization is performed by the pure or true errordiffusion method for all the area of the image. Thereby, images superiorin resolution are formed. Accordingly, the character mode is suited forimages of characters or line drawings for which high resolution isdesired.

The character/photograph mode is suited for outputting images havingcharacteristics intermediate between those of the above-mentioned twomodes. When the character/photograph mode is specified, the ditherthreshold matrix shown in FIG. 25B is selected. Accordingly, fornon-edge portions, smooth images superior in stability are formed byhalftone spots having image space frequency of 300 Lpi in 600 dpi.

In such a configuration in which a plurality of modes can be specified,and the dither threshold matrix is switched according to the specifiedmode, suitable quantization processing is performed on image data havingvarious characteristics, and, thereby, it is possible to formwell-balanced high-grade images.

For the purpose of achieving a similar object, it is also possible toswitch the dither threshold matrix in each of the threshold generatingparts 145_0 through 145_3 in the quantization threshold generating part1140 shown in FIG. 24 according to the specified mode.

Each of the above-described seventh, eighth, ninth, tenth, eleventh,twelfth and thirteenth embodiments may be achieved by software using ageneral-purpose computer such as that shown in FIG. 13.

In this case, a program for achieving the functions of the respectiveparts of the image processing apparatus is read from one of variousrecording media such as a floppy disk, an optical disk, amagneto-optical disk, a semiconductor storage device, and so forththrough a suitable drive device, or received from an external computervia a network through a communication device, is then loaded in a mainmemory, and is then executed by a CPU.

Accordingly, it is possible to achieve the image processing apparatus bythe general-purpose computer. Storage areas of the main memory may beused as line memories and so forth necessary for storing signals, andsignal delay for example.

Such various computer-readable recording media (floppy disk, opticaldisk, magneto-optical disk, semiconductor storage device, and so forth)in which such a program is recorded are included in the presentinvention.

The image processing apparatus in any of the above-described seventh,eighth, ninth, tenth, eleventh, twelfth and thirteenth embodiments maybe incorporated in apparatuses relating to image formation such as aprinter, a display and so forth, apparatuses relating to image readingsuch as a scanner, a facsimile machine, and so forth, and apparatusesrelating both to image reading and image formation such as a digitalcopier and so forth.

As one example thereof, a digital copier to which the above-mentionedembodiment of the present invention is applied will now be described (asa fourteenth embodiment of the present invention).

The general sectional view of the digital copier in the fourteenthembodiment is the same as that shown in FIG. 14, and all theparts/components thereof are the same as those shown in FIG. 14, thedescription thereof being omitted. However, the circuit part 550 of thesixth embodiment is replaced by a circuit part 1550 (FIG. 26) in thefourteenth embodiment.

FIG. 26 shows a simplified block diagram of one example of the circuitpart 1550 of that digital copier.

The circuit part 1550 is the same as the circuit part 550 shown in FIG.15 except that the error diffusion processing part 110, image datachange detecting part 120, quantization threshold generating part 130and signal delaying part 140 are replaced by a halftone processing part1560. The same reference numerals are given to the same parts as thoseof FIG. 15, and description thereof is omitted.

The halftone processing part 1560 is the image processing apparatus inany of the above-described seventh, eighth, ninth, tenth, eleventh,twelfth and thirteenth embodiments.

The image data having undergone the filter processing performed by thefilter processing circuit 554 is input to the image characteristicsextracting part 1130. The image data having undergone the γ correctionperformed by the γ correction circuit 555 is input to the errordiffusion processing part 1120 via the signal delaying part 1150. Thequantized data output from the error diffusion processing part 1120 issent to the light emitting control part of the semiconductor laser inthe writing optical unit 508.

It is possible to omit the signal delaying part 1150 as a result of thefilter processing circuit 554 adjusting timing of the signal to beoutput to the image characteristics extracting part 1130.

Further, in the digital copier, size changing processing of image datain the main scanning direction may be performed antecedent to the γcorrection circuit 555, for example, background removal processingand/or flare removal processing may be performed between the γcorrection part 555 and halftone processing part 1560, for example,and/or 90° rotation processing may be performed antecedent to the filterprocessing part 554 or subsequent to the halftone processing part 1560,for example, description thereof being omitted.

A fifteenth embodiment of the present invention will now be described.

In the fifteenth embodiment, in an image processing apparatus having theconfiguration shown in FIG. 16, the fluctuating value generating part1141 uses 4×4 dither threshold tables such as those shown in FIGS. 27Aand 27B, in each of which thresholds from −7 to +8 around 0 are arrangedso that these thresholds increase spirally outward from the centerthereof, for example. The other configuration is the same as that of theseventh embodiment.

Such a table is applied to each set of pixels of an original image so asto cover the entire area of the original image. Then, theabove-mentioned coefficients of the dither threshold table are read outaccording to the target-pixel positions. Thereby, the fluctuating valuegenerating part 1141 generates the fluctuating value which oscillatesbetween −7 and +8 cyclically in image space.

The dither threshold cycle is 4 pixels which corresponds to 150 Lpi in acase where image formation of 600 dpi.

This fluctuating value generating part 1141 can be easily achieved byusing a ROM storing the dither threshold table, counters counting timingpulses in the main and sub-scanning of the image data so as to generatereading addresses for the ROM, and so forth.

The multiplying part 1142 multiplies the fluctuating value (output valueof the fluctuating value generating part 1141) by the multiplicationfactor 8 when the edge degree represented by the detection data from theimage data change detecting part 120 is the level 8 (non edge), themultiplication factor 7 when the edge degree is the level 7, themultiplication factor 6 when the edge degree is the level 6, themultiplication factor 5 when the edge degree is the level 5, themultiplication factor 4 when the edge degree is the level 4, themultiplication factor 3 when the edge degree is the level 3, themultiplication factor 2 when the edge degree is the level 6, themultiplication factor 6 when the edge degree is the level 7 and themultiplication factor 0 when the edge degree is the level 0 (maximumedge degree).

Accordingly, the output value of the multiplying part 1142 oscillates inthe maximum oscillation range between +64 and −56 when the edge degreeis the level 8 (non edge). The fixed value added by the adding part 1143is selected to be +128 (decimal) which is the medium value of the rangeof the image data.

Accordingly, the quantization threshold provided to the quantizer 1121oscillates around +128, and the maximum oscillation range thereof is 120(between +192 and −72).

When the quantized data 1101 of the thus-configured image processingapparatus is provided to an electrophotographic printer or the like forexample, it is possible to produce high-grade images, at high resolutionfor image-data changing points or halftone-spot images of relatively lowhalftone-spot cycles per inch (coarse halftone-spot images), smooth andstable for photographs, portions in which image data changes gently, orhalftone-spot images of high halftone-spot cycles per inch (finehalftone-spot images), and in which these different regions match eachother without sense of incongruity.

Specifically, for a portion in an image in which change of image data issharp and the edge level is the level 0 (where the edge degree ishighest) such as an edge portion of a character or a line drawing, thequantization threshold generated by the quantization thresholdgenerating part 1140 is fixed to +128. Thereby, a true or pure errordiffusion method is used for quantization using the fixed threshold inthe error diffusion processing part 1120. Accordingly, it is possible toform a high-resolution image.

For a portion such as a photograph or a flat portion of an image inwhich the edge degree is low (the edge level is high), the oscillationrange of the quantization threshold generated by the quantizationthreshold generating part 1140 is wide. Accordingly, the quantizationprocessing of the error diffusion processing part 1120 is processingmainly according to the dithering technique in which dots areconcentrated. Thereby, the image data is converted to form halftonespots at the dither threshold cycles, and an image based on ditheringhaving superior graininess and stability is formed.

Because the dither threshold matrix having the threshold arrangementshown in FIG. 27A or 27B is used for generation of quantizationthresholds, output dots develop spirally from the central portion ineach dither threshold cycle as the shade level of image data increases.

When an original image is read by a scanner, main scanning is maderightward, as indicated by thin arrows shown in FIG. 33, andsub-scanning is made downward, ordinarily. Then, image data is input inthe order of reading, and, thereby, the direction of quantizationprocessing by the error diffusion processing part 1120, that is, thedirection of propagation of quantization errors is the direction fromthe top left to the bottom right as indicated by the thick arrow shownin FIG. 33.

In this case, the quantization threshold table shown in FIG. 27A is usedby the fluctuating value generating part 1141. Thereby, for an imageflat portion, the quantization thresholds shown in FIG. 29 are generatedin a dither threshold cycle of 4 pixels×4 pixels. Accordingly, outputdots are generated in the order shown in FIG. 28. That is, the outputdots (halftone spot)develop spirally clockwise from the inside to theoutside. The states of development of dots in a light-shade (low-shade)portion, a medium-shade portion and a dark-shade (high-shade) portion ofan image are shown in FIGS. 30, 31 and 32, respectively.

As shown in FIGS. 30 and 31, the output dots concentrate in the lightand medium-shade portions, and the output dots of adjacent ditherthreshold cycles do not come into contact with one another. Accordingly,it is possible to form images in which graininess is satisfactory andstability is superior in light-shade and medium-shade image flatportions.

Further, in the central portion of the dither threshold matrix, thethresholds are arranged in such a manner that the threshold increases inthe sub-scanning direction with priority. Specifically, in light-shadeportions, as can be seen from FIG. 28, output dots develop upward first,and, then, develop downward. Accordingly, in light-shade portions, dotsdevelop in the sub-scanning direction with priority (vertical-based dotdevelopment).

When such a dot development manner that dots develop in the sub-scanningdirection with priority is applied, especially in a case where theapplication is made to image formation by a electrophotographic printer,noise due to causes other than image processing such as banding is notlikely to adversely affects, in comparison to a case where dots developin the main scanning direction with priority (horizontal-based dotdevelopment), and, thereby, high-grade images superior in stability canbe formed.

When an original image is read where main scanning is made leftward, asindicated by thin arrows shown in FIG. 34, and sub-scanning is madedownward and image data is input in the order of reading, the directionof quantization processing by the error diffusion processing part 1120,that is, the direction of propagation of quantization errors is thedirection from the top right to the bottom left as indicated by thethick arrow shown in FIG. 34.

In this case, the quantization threshold table shown in FIG. 27B is usedby the fluctuating value generating part 1141. Thereby, for an imageflat portion, the quantization thresholds shown in FIG. 36 are generatedin a dither threshold cycle of 4 pixels×4 pixels. Accordingly, outputdots are generated in the order shown in FIG. 35. Thus, output dots(halftone spot) develop spirally counterclockwise.

In quantization processing by the error diffusion method, positions atwhich dots are generated shift due to effect of diffusion ofquantization errors. Accordingly, output dots may not develop in lightor medium-shade portions as described above. However, when output dotsare caused to develop clockwise when quantization processing is madefrom the top left to the bottom right and when output dots are caused todevelop counterclockwise when quantization processing is made from thetop right to the bottom left as described above according to the presentinvention, neat dot concentration is likely to be made in each ditherthreshold cycle, due to relationship with propagation directioncharacteristics of quantization errors, and, thereby, stability andgraininess in light and medium-shade portions are improved.

Further, at a boundary between a region in which the edge degree is highand a region in which the edge degree is low, the oscillation range ofthe quantization threshold changes gradually according to the edgedegree. Thereby, the characteristics of the processing is smoothlyswitched from the processing mainly according to the error diffusiontechnique to the processing mainly according to the dithering technique,and vise versa. Accordingly, it is possible to form images in whichthere is no incongruousness in boundaries between both image regions.

The region expansion processing part 1132 of the image characteristicsextracting part 1130 performs region expansion processing of the extentof 7 pixels. In the case of 600 dpi, the expansion extent of theabove-mentioned 7 pixels of the region expansion processing correspondsto approximately 0.3 mm on the original image, and this corresponds tothe halftone-spot cycles per inch (image space frequency) ofapproximately 86 Lpi (lines per inch). Accordingly, through the regionexpansion processing, a fine halftone-spot image higher than 86 Lpi isevaluated as an edge portion, and, therefor, processing mainly accordingto the error diffusion technique using a fixed quantization threshold ora oscillating quantization threshold in a narrow oscillation range isperformed in the error diffusion processing part 1120. Thereby, it ispossible to reproduce halftone spots faithfully with high resolution,and to prevent moiré patterns from being generated.

As described above, halftone-spot components of high halftone-spotcycles per inch equal to or higher than 175 Lpi are not left in thesmoothed image data 1100. Accordingly, for halftone-spot images of suchhigh halftone-spot cycles per inch, the edge level is the level 8 orhigh level (very low edge degree). Thereby, they are processed mainlyaccording to the dithering technique using oscillating quantizationthreshold in a wide oscillation range same as for image flat portions.Thereby, they are converted into halftone spots at the dither thresholdcycles (150 Lpi). Accordingly, it is possible to form images superior ingraininess and stability. Further, because halftone-spot components arepreviously removed from the image data 1100, no moiré patterns aregenerated.

For halftone-spot images of low halftone-spot cycles per inch lower than86 Lpi, halftone-spot boundary portions evaluated as edges are processedmainly according to the error diffusion technique using fixedquantization thresholds or oscillating quantization thresholds in narrowoscillation ranges. Accordingly, the contours of the halftone spots arereproduced faithfully, and also, moiré patterns are prevented from beinggenerated. Further, halftone-spot central portions not evaluated asedges are processed mainly according to the dithering technique usingoscillating quantization thresholds in wide oscillation ranges.Accordingly, it is possible to express these portions with satisfactorystability and graininess.

A sixteenth embodiment of the present invention will now be described.

In the sixteenth embodiment of the present invention, in an imageprocessing apparatus having the configuration shown in FIG. 16, thefluctuating value generating part 1141 of the dither thresholdgenerating part 1140 uses the 8×8 dither threshold matrix shown in FIG.37, and generates a dither threshold oscillating in image spacecyclically between −7 and +8. The other configuration is the same asthat of the above-described seventh embodiment.

The dither threshold matrix shown in FIG. 37 is obtained as a result ofthe 4×4 basic dither thresholds enclosed by the thick line (the same asthe dither threshold matrix shown in FIG. 27A) being copied and four ofthem being combined, and thus the basic dither threshold matrix beingmagnified to a 8×8 size. In the arrangement, the basic dither matrixesadjacent in the main scanning direction are shifted in the sub-scanningdirection relatively by the half phase.

By using such a dither threshold matrix, for image flat portions forwhich processing mainly based on dithering technique is performed, wherehalftone spots corresponding to 150 Lpi are formed in 600 dpi, becausehalftone-spot development starting points are arranged staggeringly, itis possible to form images superior in stability especially forlight-shade portions.

When such a dither threshold matrix is used, for image flat portions forwhich processing mainly based on the dithering technique is performed,halftone-spot arrangements such as those shown in FIGS. 38, 39 and 40are obtained for light-shade, medium-shade and dark-shade portions,respectively, and the screen angle of approximately 63.5° is formed.Accordingly, such a dither threshold matrix is suited for errordiffusion processing, causes no deformation of halftone spots, andprovides satisfactory graininess.

The dither threshold generating part 1141 does not necessarily need tohave a ROM storing the 8×8 dither threshold matrix shown in FIG. 37, butmay have a ROM storing the 4×4 dither threshold matrix, and may generatethe thresholds of the 8×8 dither threshold matrix shown in FIG. 37 bycontrolling reading addresses.

A seventeenth embodiment of the present invention will now be described.

In the seventeenth embodiment, in an image processing apparatus havingthe configuration shown in FIG. 16, the fluctuating value generatingpart 1141 of the dither threshold generating part 1140 uses the 4×4dither threshold matrix shown in FIG. 41 in which the thresholds from −7to +2 are arranged in a manner such that the thresholds are arrangedspirally clockwise in the ascending order of the thresholds, and thethresholds more than 2 are arranged in a manner such that the thresholdsare dispersed radially in the ascending order of the thresholds, andgenerates a dither threshold oscillating in image space cyclicallybetween −7 and +8. The other configuration is the same as that of theabove-described seventh embodiment.

When this dither threshold matrix is used, for image flat portions forwhich processing mainly based on dithering technique is performed, thequantization thresholds shown in FIG. 42 are generated in a ditherthreshold cycle. Accordingly, states of output dot development forlight-shade, medium-shade and dark-shade portions are those shown inFIGS. 43A, 43B and 43C.

As shown in FIG. 43C, output dots develop dispersedly in the peripheryof a dither threshold cycle. Accordingly, as is obvious from comparisonwith FIG. 32, a white blank remaining phenomenon occurring in adark-shade allover painted portion can be relieved. Further, in light ormedium-shade portions, concentration of dots is positively made.Accordingly, it is possible to form high-grade images superior instability and in which white blank remaining phenomena are notremarkable.

An eighteenth embodiment of the present invention will now be described.

In the eighteenth embodiment, in an image processing apparatus havingthe configuration shown in FIG. 16, the fluctuating value generatingpart 1141 of the dither threshold generating part 1140 uses the 4×4dither threshold matrix shown in FIG. 44 in which the thresholds from −7to −4 are arranged in the central portion concentratedly and thethresholds from −3 to +8 are arranged in the periphery so as to disperseradially, and generates a dither threshold oscillating in image spacecyclically between −7 and +8. The other configuration is the same asthat of the above-described seventh embodiment.

When this dither threshold matrix is used, for image flat portions forwhich processing mainly based on dithering technique is performed,output dots are generated in the order shown in FIG. 45. That is, forlight-shade portions, output dots develop concentratedly in the centralportion of each dither threshold cycle, and, for medium or dark-shadeportions, output dots develop radially. Because output dot developmentis made in such a manner, the center of each halftone spot formed islocated approximately at the center of a respective dither thresholdcycle, through from light-shade portions to dark-shade portions.Accordingly, shift of halftone spots is reduced. Thereby, smooth andhigh-grade image which are not likely to be adversely affected by changein shade can be formed.

A nineteenth embodiment of the present invention will now be described.

In the nineteenth embodiment, in an image processing apparatus havingthe configuration shown in FIG. 16, the quantization thresholdgenerating part 1140 has the configuration shown in FIG. 46.

Further, the image change detecting part 1131 of the imagecharacteristics extracting part 1130 (FIG. 16) is changed so as toquantize the edge amount into 2-bit edge data which can represent 4 edgelevels from the level 0 (the highest edge degree)to the level 3 (nonedge).

In the nineteenth embodiment, the quantization threshold generating part1140 includes four threshold generating parts 1145_0 through 1145_3which generate fluctuating values having oscillation rangescorresponding to the respective levels 0 through 3 of the edge degree,respectively, and a selecting part 1146 which selects one of thesefluctuating values generated by the threshold generating parts 1145_0through 1145_3 according to the edge level indicated by the edge datainput from the image characteristics extracting part 1130, and providesthe selected fluctuating value to the quantizer 1121 of the errordiffuison processing part 1120 (FIG. 16) as the quantization threshold.

The threshold generating part 1145_3 corresponding to the edge level 3(non edge) uses the dither threshold matrix obtained from multiplyingeach threshold of the dither threshold matrix used in any of theabove-described fifteenth, sixteenth, seventeenth and eighteenthembodiments (FIGS. 27A, 27B, 37, 41 and 44) by 8, and then, adding 128thereto, and generates the threshold oscillating in the maximumoscillating range.

The threshold generating part 1145_2 corresponding to the edge level 2uses the dither threshold matrix obtained from multiplying eachthreshold of that dither threshold matrix in the above-describedembodiment by 5, and then, adding 128 thereto, and generates thethreshold oscillating in the smaller oscillating range.

The threshold generating part 1145_1 corresponding to the edge level 1uses the dither threshold matrix obtained from multiplying eachthreshold of that dither threshold matrix in the above-describedembodiment by 2, and then, adding 128 thereto, and generates thethreshold oscillating in the further smaller oscillating range.

The threshold generating part 1145_0 corresponding to the edge level 0(the highest edge degree) generates the fixed value (+128).

Accordingly, also in the nineteenth embodiment, it is obvious that, thesame quantization threshold generating processing as that of any of thefifteenth, sixteenth, seventeenth and eighteenth embodiments isperformed, and, thereby, high-grade images can be formed.

In the nineteenth embodiment, it is possible to eliminate a part formultiplication processing (corresponding to the multiplying part 1142shown in FIG. 16) which is disadvantageous in view of costs andprocessing time whether the quantization threshold generating part 1140is achieved by hardware or software.

Further, although the region expansion processing part 1132 needs totemporarily store the edge data for the plurality of lines correspondingto the region expansion extent, it is possible to reduce the capacity ofline memories or the like for the temporarily storage as the edge datais reduced to 2-bit data.

Furthermore, because the number of edge degree levels is small, i.e., 4,the memory amount needed for the threshold generating dither thresholdtables in the threshold generating parts 1145_0 through 1145_3 is small.

Further, although the storage capacity of the region expansionprocessing part 1132 is not reduced, it is also possible that the edgedetecting part 1131 outputs the nine edge levels, and the nine edgelevels are converted into four levels in the region expansion processingpart 1132 and are output therefrom.

Each of the above-described fifteenth, sixteenth, seventeenth,eighteenth and nineteenth embodiments may be achieved by software usinga general-purpose computer such as that shown in FIG. 13.

In this case, a program for achieving the functions of the respectivepart of the image processing apparatus is read from one of variousrecording medium such as a floppy disk, an optical disk, amagneto-optical disk, a semiconductor storage device, and so forththrough an appropriate drive device, or received from an externalcomputer via a network through a communication device, is then loaded ina main memory, and is then executed by a CPU.

Accordingly, it is possible to achieve the image processing apparatus bythe general-purpose computer. Storage areas of the main memory may beused as line memories and so forth necessary for storing signals, andsignal delay, for example.

Such various computer-readable recording media (floppy disk, opticaldisk, magneto-optical disk, semiconductor storage device, and so forth)in which such a program is recorded are included in the presentinvention.

The image processing apparatus in any of the above-described fifteenth,sixteenth, seventeenth, eighteenth and nineteenth embodiments may beincorporated in apparatuses relating to image formation such as aprinter, a display and so forth, apparatuses relating to image readingsuch as a scanner, a facsimile machine, and so forth, and apparatusesrelating both to image reading and image formation such as a digitalcopier and so forth.

As one example thereof, a digital copier to which the above-mentionedembodiment of the present invention is applied will now be described (asa twentieth embodiment of the present invention).

The general sectional view of the digital copier in the twentiethembodiment is the same as that shown in FIG. 14, and all theparts/components thereof are the same as those shown in FIG. 16, thedescription thereof being omitted. However, the circuit part 550 of thesixth embodiment is replaced by a circuit part 1550 (FIG. 26) in thetwentieth embodiment.

FIG. 26 shows a simplified block diagram of one example of the circuitpart 1550 of this digital copier.

The circuit part 1550 is the same as the circuit part 550 shown in FIG.15 except that the error diffusion processing part 110, image datachange detecting part 120, quantization threshold generating part 130and signal delaying part 140 are replaced by a halftone processing part1560. The same reference numerals are given to the same parts as thoseof FIG. 15, and description thereof is omitted.

The halftone processing part 1560 is the image processing apparatus inany of the above-described fifteenth, sixteenth, seventeenth, eighteenthand nineteenth embodiments.

The image data having undergone the filter processing performed by thefilter processing circuit 554 is input to the image characteristicsextracting part 1130. The image data having undergone the γ correctionperformed by the γ correction circuit 555 is input to the errordiffusion processing part 1120 via the signal delaying part 1150. Thequantized data output from the error diffusion processing part 1120 issent to the light emitting control part of the semiconductor laser inthe writing optical unit 508.

It is possible to omit the signal delaying part 1150 as a result of thefilter processing circuit 554 adjusting timing of the signal to beoutput to the image characteristics extracting part 1130.

Further, in the digital copier, size changing processing of image datain the main scanning direction may be performed antecedent to the γcorrection circuit 555, for example, background removal processingand/or flare removal processing may be performed between the γcorrection part 555 and halftone processing part 1560, for example,and/or 90° rotation processing may be performed antecedent to the filterprocessing part 554 or subsequent to the halftone processing part 1560,for example, description thereof being omitted.

The present invention is not limited to the above-described embodiments,and variations and modifications may be made without departing from thescope of the present invention.

The present application is based on Japanese priority applications Nos.11-309413, 2000-106451 and 2000-106452, filed on Oct. 29, 1999, Apr. 7,2000 and Apr. 7, 2000, respectively, the entire contents of which arehereby incorporated by reference.

1-40. (canceled)
 41. An image processing apparatus comprising: an errordiffusion processing part which quantizes multi-tone image data by anerror diffusion method; a quantization threshold generating part whichuses a dither threshold matrix and generates a quantization thresholdfor said error diffusion processing part, the quantization thresholdoscillating cyclically; and an edge detecting part detecting an edgelevel of the image data input to said error diffusion processing part,wherein said error diffusion processing part controls an oscillationrange of the quantization threshold according to the edged leveldetected by said edge detecting part, and, also, switches the ditherthreshold matrix used for generation of the quantization thresholdaccording to a mode specified externally.
 42. An image processingapparatus comprising: an error diffusion processing part which quantizesmulti-tone image data by an error diffusion method; a quantizationthreshold generating part which uses a dither threshold matrix andgenerates a quantization threshold for said error diffusion processingpart, the quantization threshold oscillating cyclically; an edgedetecting part detecting an edge level of the image data input to saiderror diffusion processing part; and a region expansion processing partperforming region expansion processing on the edge level detected bysaid edge detecting part, wherein said error diffusion processing partcontrols an oscillation range of the quantization threshold according tothe edged level having undergone the region expansion processingperformed by said region expansion processing part, and, also, switchesthe dither threshold matrix used for generation of the quantizationthreshold according to a mode specified externally. 43-46. (canceled)47. A computer readable recording medium in which a program is recorded,the program being read therefrom and executed by a computer so as tocause said computer to perform the functions of: an error diffusionprocessing part which quantizes multi-tone image data by an errordiffusion method; a quantization threshold generating part which uses adither threshold matrix and generates a quantization threshold for saiderror diffusion processing part, the quantization threshold oscillatingcyclically; and an edge detecting part detecting an edge level of theimage data input to said error diffusion processing part, wherein saiderror diffusion processing part controls an oscillation range of thequantization threshold according to the edged level detected by saidedge detecting part, and, also, switches the dither threshold matrixused for generation of the quantization threshold according to a modespecified externally.
 48. A computer readable recording medium in whicha program is recorded, the program being read therefrom and executed bya computer so as to cause said computer to perform the functions of: anerror diffusion processing part which quantizes multi-tone image data byan error diffusion method; a quantization threshold generating partwhich uses a dither threshold matrix and generates a quantizationthreshold for said error diffusion processing part, the quantizationthreshold oscillating cyclically; an edge detecting part detecting anedge level of the image data input to said error diffusion processingpart; and a region expansion processing part performing region expansionprocessing on the edge level detected by said edge detecting part,wherein said error diffusion processing part controls an oscillationrange of the quantization threshold according to the edged level havingundergone the region expansion processing performed by said regionexpansion processing part, and, also, switches the dither thresholdmatrix used for generation of the quantization threshold according to amode specified externally. 49-73. (canceled)